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EUGENE STRAHOV 

Abstract. Normalized irreducible characters of the symmetric group S(n) can be un- 
derstood as zonal spherical functions of the Gelfand pair (S(n) x S(n), diag S(n)). They 
form an orthogonal basis in the space of the functions on the group S(n) invariant with 
respect to conjugations by S(n). In this paper we consider a different Gelfand pair con- 
nected with the symmetric group, that is an "unbalanced" Gelfand pair (S(n) x S(n — 
l),diagS'(n — 1)). Zonal spherical functions of this Gelfand pair form an orthogonal 
basis in a larger space of functions on S(n), namely in the space of functions invariant 
with respect to conjugations by S(n — 1). We refer to these zonal spherical functions as 
normalized generalized characters of S(n). The main discovery of the present paper is 
that these generalized characters can be computed on the same level as the irreducible 
characters of the symmetric group. The paper gives a Murnaghan-Nakayama type rule, a 
Frobenius type formula, and an analogue of the determinantal formula for the generalized 
characters of S(n). 



1. Introduction 

1.1. Preliminaries and formulation of the problem. One of the central goals of 
the representation theory of finite groups is in computation of characters of irreducible 
representations. When a group under considerations is the symmetric group, S(n), the 
irreducible characters can be computed using either the Frobenius formula, or the deter- 
minantal formula, or the Murnaghan-Nakayama rule (see, for example, Macdonald |Macj . 
Sagan |S], Stanley jSij). 

Let A denote the algebra of symmetric functions, which is a graded algebra, isomorphic 
to the algebra of polynomials in the power sums pi,P2, — If we define p p = p Pl p P2 ■ ■ ■ 
for each partition p = (pi, p%, . . .) , then the p p form a homogeneous basis in A. Another 
natural homogeneous basis in A is formed by the Schur functions s\ indexed by Young 
diagrams A. The Frobenius formula is 

Ahn 

where x P is the value of the irreducible character x X OI the symmetric group S(n) on the 
conjugacy class in S(n) indexed by the partition p of n. This formula is the key result in 
the classical theory of characters of the symmetric group S(n). It shows that the character 
table is the transition matrix between two bases p p and s\ in the algebra of symmetric 
functions A. The Frobenius formula follows from the fact that the Schur functions s\ are 
images of x A in A under a certain map. This map is called the characteristic map, see 
|Macj I, §7. Thus, if we denote this map by ch, we have 

s x = ch( X A ). 

Another available result on irreducible characters of S(n) is the formula which represents 
an irreducible character, x ■> as an alternating sum of the induced characters (i.e. the 

^As in Macdonald |Mac| we identify each partition with its Young diagram. 
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determinantal formula). Namely, denote by % the identity character of S(k). If A = 
(Ai, A2, • • •) is any partition of n, let rj\ denote rjx 1 • rj\ 2 • . . .. Here the multiplication, / • g, 
between two characters, / and g, of, say, groups S(k) and S(m) is defined by the induction 

With the above notation the irreducible character x A is given by 

X A = det (VXi-i+j)^^ ■ 

Since c1i(?7a) = h\, where h\ = h\ 1 h\ 2 . . . , and h r is the rth complete symmetric func- 
tion, the determinantal formula for irreducible characters is equivalent to the Jacobi-Trudi 
formula for the Schur symmetric functions, 

s x = det(fc Ai _ i+i ) 1 < w < n . 

The Murnaghan-Nakayama rule is a recursive method to compute the irreducible char- 
acters of the symmetric groups. It can be formulated as follows. Let us say that a skew 
Young diagram is a border strip if it is connected and does not contain any 2x2 block 
of boxes. Suppose that no~ is an element of the symmetric group S(n), where a is a cycle 
of length j, and tt is a permutation of the remaining n — j numbers of cycle- type p, p 
is a partition of n — j. The Murnaghan-Nakayama rule says that the value of the irre- 
ducible character of S{n) parameterized by the Young diagram A on the element tra (i.e. 
of x X ( 7Ta )) is given by 

x A (vro-) = ^ 4>x/vXp 

i/CA 
u\-n—j 

where <f>\/ v is a combinatorial coefficient. This combinatorial coefficient is defined by the 
formula 

(— l)^l u \ if \jv is a border strip; 
0, otherwise, 

where (A/V) is the height of a border strip defined to be one less than the number of rows 
it occupies. 

The theory of characters can be reformulated in terms of Gelfand pairs, see [Mac], VII, 
§1. Specifically, let G be a finite group, and K be a subgroup of G. Denote by C(G,K) 
the algebra of complex valued functions / on G (with convolution as the multiplication) 
such that f(kxk') = f(x) for all x € G and k, k! € K. If C(G,K) is commutative, the 
pair (G, K) is called a Gelfand pair, and one can associate with (G, K) the set of zonal 
spherical functions. Zonal spherical functions have many remarkable properties, some of 
these properties are analogous to those of group characters. In particular, the set of zonal 
spherical functions defines an orthogonal basis of C(G,K), see (Mac], VII, §1. 

If K is a finite group, then the normalized irreducible characters of K are closely 
connected with the zonal spherical functions of the Gelfand pair {K x K, diag-KT), see 
Mac , VII, §1, Ex.9, and Section [5] below. (Here diag-fT = {(x,x) : x € K} is the diagonal 
subgroup of K x K.) Explicitly, let Xi (1 ^ i ^ r ) De the irreducible characters of K, and 
k>i (1 < i < r) be the zonal spherical functions of the Gelfand pair (K x K, diagiT). Then 
for all elements x, y of the group K the following formula holds 

(1.1.1) Ui(x,y) = -— . 

Xi e 
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In this situation C(K x K, diagK) can be identified with the algebra of central functions 
/ defined on the group K, i.e. it consists of the functions / such that /(xyx -1 ) = f(y) 
for all x,y £ K. In particular, if K = S(n), where S(n) denotes the symmetric group of 
symbols 1,2, ... ,n, then C(S(n) x S(n), diag S(n)) can be identified with the algebra of 
central functions defined on S(n). We will denote this algebra by C(n). Since the zonal 
spherical functions of the Gelfand pair (S'(n) x S(n), diag S(n)) can be expressed in terms 
of the normalized irreducible characters of S(n), the irreducible characters of S(n) form 
an orthogonal basis in C(n), i.e. in the space of central functions. 

The theory of characters in such formulation can be extended to the Gelfand pairs 
(S(2n),H(n)) where H(n) is the hyperoctahedral group of degree n , see |Macj . VII, 
§2. In particular, the zonal polynomials (i.e. the Jack symmetric functions jjr 1 ' with 
parameter a = 2) are the images of the zonal spherical functions of (S(2n),H(n)) under 
a characteristic map, see |Macj VII, §2. 

However, there exist "unbalanced" Gelfand pairs, (S(n) x S(n — 1), diag S^n — 1)). (For 
a proof that (5(n) x S(n — 1), diag S(n — 1)) is a Gelfand pair see Travis |Travj . Brender 
|Brenj . and Section 2 below). The algebra C(S(n) x S(n — 1), diag S(n — 1)) can be identi- 
fied with the algebra of complex valued functions defined on the group S(n) invariant with 
respect to the conjugations by the subgroup S(n — 1) of S(n). It consists of the functions 
/ on S(n) such that f{xyx~ l ) = f(y) for all x € S(n — 1) and y £ S(n). We will denote 
this algebra by C'(n). 

Thus, instead of conventional conjugacy classes in the symmetric group S(n) we will 
deal with the conjugacy classes in S(n) defined with respect to S(n — 1). Suppose that 
the symmetric group S(n) is realized as the group of permutations of the set {1,2,..., n}, 
and the subgroup S(n — 1) of S(n) is realized as the group of permutations of the set 
{1,2, ... ,n— 1}. Then the conjugacy classes with respect to S(n — 1) can be parameterized 
by pairs of Young diagrams (p, a y p) where p is a Young diagram with n boxes, a is a 
Young diagram with n — 1 boxes, and the notation a y p means that p is obtained from 
a by adding one box, see Section 12.51 for details. It turns out that the zonal spherical 
functions of (S(n) x S(n — l),diagS'(n — 1)) can be parameterized by pairs of Young 
diagrams (A, p /* A) as well. Let us denote these zonal spherical functions by 
For all elements x £ S(n) and y E S(n — 1) these spherical functions can be expressed 
explicitly as: 

^\x,y) = T ^— X X (xz) X ^yz), 
(n — 1 ! 

y ' zeS(n-l) 

see Brender |Brenj and Section 2 below for more details. 

Motivated by relation (jl.l.lj) (which connects irreducible characters of a finite group K 
with zonal spherical functions of "balanced" Gelfand pairs (K x K, diagi'T)) we define a 
generalized character of S(n), r A,At /' A , by the following formula: 

T x '^ x (x) = x M (e) -uj x '^ x (x,e). 

Note that functions T x,fl// ' x on the group S(n) introduced above define an orthogonal basis 
in the space C'(n), in contrast to the irreducible characters of the group S(n) which define 
an orthogonal basis in the subspace C(n) of C'(n). For this reason we refer to T x,fJ// ^ x as 
to generalized characters of S(n). 

The present paper aims to compute these generalized characters on the same level as 
it is done in the classical theory for the irreducible characters of the finite symmetric 
group. We find analogues of the Frobenius formula, of the determinantal formula and of 
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the Murnaghan-Nakayama rule for these generalized characters. Thus we find the same 
type of results for these objects as for the irreducible characters of the symmetric group. 

1.2. Summary of results. 

1.2.1. A Murnaghan-Nakayama type rule. For the generalized characters T x,fJ,/ ^ x of the 
finite symmetric group we derive a Murnaghan-Nakayma type rule, see Theorem 13.2.11 
This is the first main result of the present paper. Its proof is based on a rational function 
identity, Theorem 14.5. 11 for certain algebraic expresseions parameterized by pairs (A, fi f 
A) of Young diagrams. 

1.2.2. A characteristic map. In Section|S]we introduce the space C'(n) of (complex-valued) 
functions on S(n) invariant with respect to conjugations by elements of the subgroup 
S(n — 1) of the group S(n), and set 

C = C'{n). 

n>l 

Then we construct an isomorphism between C and A[i], where A[t] is the space of poly- 
nomials in t whose coefficients are elements of A, i.e. these coefficients are symmetric 
functions. This isomorphism is an analogue of the characteristic map in the classical the- 
ory. We then define in Section generalized Schur functions as images of the generalized 
characters under this map. 

1.2.3. A Frobenius type formula for the generalized characters. The second main result 
of the present paper is the Frobenius type formula for the generalized characters T x,fJ// ^ x , 
equation (|fi.3,2[) . This formula presents the table of the generalized characters as the 
transition matrix between two bases in A[t]. These bases are analogues of two bases in A 
involved in the classical Frobenius formula, namely of the Schur symmetric functions, and 
of the power sum symmetric functions. 

1.2.4. Analogues of the J acobi-Trudi formula and of the determinantal formula. The third 
main result of the present paper is in obtaining an analogue of the Jacobi-Trudi formula 
for generalized Schur functions, equation (|6.5.6|) . This formula can be also understood as 
an analogue of the determinantal formula for the irreducible characters of the symmetric 
group. 

1.3. Remarks on related works. 

1.3.1. Zonal spherical functions on finite groups were studied by many authors, see 
e.g. Travis |Travj . Gallagher |Galj and references therein. The zonal spherical func- 
tions associated with the Gelfand pair (S(n) x S(n — l),diag5(n — 1)) were consid- 
ered previously by Brender |Brenj . This author proves a certain general averaging the- 
orem and uses it to indicate how some calculations of values can be carried out for 
(S(n) x S(n — l),diagS(n — 1)). However, any explicit formula for the zonal spheri- 
cal functions of the Gelfand pair (S(n) x S(n — 1), diag S(n — 1)) has not been previously 
known, to the best of the author's knowledge. 
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1.3.2. Zonal spherical functions are orthogonal, and in some cases can be expressed in 
terms of hypergeometric functions. In particular, classical discrete Hahn and Krawtchouk 
polynomials can be obtained in such a way. Namely, zonal spherical functions of the 
Gelfand pair (H(n),S(n)) (where H(n) is the hyperocthachedral group) are expressed in 
terms of the Krawtchouk polynomials, see Bannai and Ito [Ban]. By considering another 
Gelfand pair, namely (S(n),S(n — k) x S(k)), one obtains the Hahn polynomials. There 
are generalizations of these results, see Mizukawa |Mizj . Akazawa and Mizukawa [AkMizj . 
Mizukawa and Tanaka Miz Tanj . 

1.3.3. Our derivation of the Murnaghan-Nakayama rule for the generalized characters 
(see Theorem 13,2. lj) starts from a projection formula, see Section 14.11 This formula was 
known previously (see Travis jTravj . Brender |Brenj . Olshanski OIsIl). The main idea of 
the proof of Theorem 13.2. II is to use Young's orthogonal representation of the symmetric 
group, and sum up the corresponding diagonal elements. A similar method was used by 
Greene |Grj to give a combinatorial derivation of the classical Murnaghan-Nakayama rule 
for the irreducible characters of S(n). The involved summation procedure in our case is 
based on a rational functional identity which is an analogue of Theorem 3.3 in Greene 
|Grj . Note that paper by Halverson and Ram HalRam takes a similar approach to 
derive the characters of the Iwahori-Hecke algebras of type A n _i, B n and D n . For recent 
Murnaghan-Nakayama type rules for Coxeter groups, Hecke algebras and Lie algebras see 
e.g. Halverson and Ram HalRam] and references therein. A survey paper by Roichmann 
|Roichj presents different combinatorial versions of the classical Murnaghan-Nakayama 
algorithm. 

1.3.4. In the classical theory the Frobenius formula can be viewed as a result of the 
Schur-Weyl duality between S(n) and GL(n,C) in tensors 

c%c%...®c w , 

* v ' 

n times 

see, for example Goodmann and Wallach |GW| . In particular, it follows that Schur sym- 
metric functions are irreducible characters of GL(n, C). It will be interesting whether there 
is some analogue of the Schur-Weyl duality in the case considered in the present paper. The 
paper by Knop Knop| studies zonal spherical functions for the Gelfand pairs (G, K) where 



G is a classical group, but G/K is not a symmetric space. One of the Gelfand pairs of this 
type is (GL(n, C) x GL(n — 1, C), diag GL{n — 1, C)). The author is not aware if there exists 
a relation between the spherical functions of (GL(n, C) x GL(n — 1, C), diag GL(n — 1, C)) 
and the generalized Schur functions introduced in the present paper. 
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to introduce the characteristic map as in Section |S] was suggested by Grigori Olshanski. 
I also thank Alexei Borodin for his interest in this work, and for his help with computer 
simulations which proved to be useful in the derivation of the Murnaghan-Nakayama type 
formula. 



2. Gelfand pairs and spherical functions on the symmetric group 



2.1. Irreducible characters of a finite group as spherical functions. The material 
of this section is standard, see Macdonald, VII, §1. Let G be a finite group. Let A = C[G] 
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be the complex group algebra of G. A can be identified with the space of all complex- 
valued functions on G. From this point of view, the multiplication in A is the convolution, 
G acts on A by the rule (xf)(y) = f(x~ 1 y), the center of A consists of the central functions 
on G. Moreover, the center of A has the irreducible characters of the group G as a basis. 
The scalar product on A is 



(f,g) G = YT\i^f(. x )a{x)- 



Let K be a subgroup of G. Denote by C(G, K) the subalgebra of C[G] which consists of 
the functions / on G such that f{kxk ! ) = f{x) for all x £ G and k, k! £ K. Thus C(G, K) 
consists of the functions constant on each double coset KxK in G. 

Theorem 2.1.1. For a subgroup K of G the following conditions are equivalent: 

1. The induced representation 1^- is multiplicity- free. 

2. The algebra C(G,K) is commutative. 

Definition 2.1.2. The pair (G, K) is called a Gelfand pair if the equivalent conditions 1, 
2 of Theorem 12.1.11 are satisfied. 

Assume from now on that (G, K) is a Gelfand pair. Then the induced representation 
1q is a direct sum of non- isomorphic irreducible G-modules, 



(2.1.1) l£ = ©2} 



i ■ 

i=l 



Definition 2.1.3. Let Xi De the character of Tj. The functions Ui defined for x £ G by 
(2.1.2) Ui (x) = E Xi{x~ l k) 

' ' keK 

are called zonal spherical functions of the Gelfand pair (G,K). 
Proposition 2.1.4. (G x G, diagG) is a Gelfand pair. 

Proof. Let Xi (1 ^ i 5; r ) De the irreducible characters of G. Then the irreducible charac- 
ters of G x G are Xi x Xj (1 ^ hj — r )- Using the Frobenius reciprocity we obtain 



(xi x Xj, ^g G ) GxG = ]g\^ ^ x )^ x ) = hCuXj) 



GxG | G | ^-v-,a. jv ~, w,^/g otherwise. 

This implies that 1^*^ is multiplicity-free, i.e. (G x G, diag G) is a Gelfand pair. □ 

From the proof of the Proposition above it is clear that the character of the induced 
representation is Ya=iXi x Xi, an d we obtain the following expression for the spherical 
functions of (G x G, diagG): 

2.1.3) uji(x,y) = -— . 

Xi{e) 

This means that the normalized irreducible characters of a finite group G can be 

understood as the zonal spherical functions Ui(x, e) of the Gelfand pair (G x G, diagG). 
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2.2. Zonal spherical functions for (S(n) x S(n — 1), diag S(n — l))-pairs. Let S(n) be 
the group of permutations of {1,2,..., n}. Let S(n — 1) be a subgroup of S(n). We agree 
that S(n — 1) is realized as the group of permutations of {1, 2, . . . , n — 1}. 

Proposition 2.2.1. (S(n) x S(n — l),diagS(n — 1)) is a Gelfand pair. 

Proof. Let A be a partition of n, and /ibea partition of n — 1. Let x A be the character of 
the irreducible representation of S(n) parameterized by A, and x 11 be the character of the 
irreducible representation of S(n — 1) parameterized by \i. Define the function x X x X^ on 
the group S(n) x S(n — 1) as follows: 

x A x X M : (x,y) ^ x x (x)x^(y) 

where x £ S(n) and y E S(n — 1). It is clear that x X x is an irreducible character of 
the group S(n) x ^(n — 1). 

The Frobenius reciprocity implies 

<x» >< x", ifiW)^,^ - ^ E »2Sr V)Wx-M 

w k ; v ' ges(n-i) 

where resf;"".. ^(x A ) denotes the restriction of the character x X of S(n) to S(n — 1). Using 
the relation 

y/A 

where i/ /* A means that A is obtained from v by adding one box, and exploiting the 
orthogonality of irreducible characters we find 

(2.2.1) (x A xxM d t )X5( ^ A -f 1 ' 



diagS(n-i) / S ( n ) xS ( n _i) |o, otherwise. 



Hence ^^^s(n—l) * s mu ^iplicity-free, and (S(n) x S(n — l),diagS(n — 1)) is a Gelfand 
pair. □ 

It is not hard to see that the character ifia * s e 1 n8 ^ to Yl X A x Indeed, 

lag { ' X\-n,fi/X 

this follows from the comparison of formula ()2.2.1j) with the following formula 



\ f^n,v/p I S (n)xS{n-l) 



1, if/i/A, 
0, otherwise. 



Proposition 2.2.2. The zonal spherical functions for (S(n)xS(n— 1), diag S(n—1)) -pairs 
are given by 

(2.2.2) w WA (X)1/ ) = _!_ £ x A (xz)x"M. 

(n — 1)! 

v y zeS(n-l) 

Proof. The formula in the statement of the Proposition follows immediately from general 
expression (|2,1.2j) for the zonal spherical functions, and from the fact that the character 

1 Ss(Sj 1) is ec * ual to E x A x □ 

Ahn,/x /"A 
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2.3. Generalized characters. Comparing ()2.1.3|) and ()2.2.2|) it is rather natural to in- 
troduce the notion of the generalized characters. 

Definition 2.3.1. Let A be a partition of n, p be a partition of n — 1, and p /* A. The 
functions on the group S(n) defined by 

(2.3.1) rWA W = Sl £ ^(xy-VGO 

will be called the generalized characters. 

Remark 2.3.2. As it is evident from equation (|2.2.2|) the normalized generalized char- 
acters of S(n) are related with the zonal spherical functions for the Gelfand pair (S(n) x 
S(n — 1), diag S(n — 1)) as follows: 

2.4. Properties of generalized characters. The following relations can be obtained 
immediately from Definition 12.3.11 and from the basic properties of the zonal spherical 
functions, equation (1.4), Macdonald, VII, §1: 

• T A '^ A (e) =x"(e). 

. rWAjyrry-i) = T A ^/" A (x) for all x € S(n),y £ S{n - 1). 

• Yl T x ^S x {xy~ l )TP> u SP{y) = -5L S^S^T^^ly). 

ye S(n) x{e) 

\ /S(n) x A (e) 

Here the scalar product is defined by 

(f,9) S (n) = ^f E f( x )s(x), 

for all functions f,gon the group S(n). 

2.5. Tables of generalized characters. We say that two permutations ir and a from 
S(n) are related by conjugation with respect to S(n— 1) if 7r = kak -1 for some permutation 
fc from 5(n — 1). The set of all permutations of S(n) related by conjugation with respect 
to S(n — 1) to a given tt is called the conjugacy class of tt with respect to S(n — 1). It 
follows that two permutations tt and a from S(n) are in the same conjugacy class with 
respect to the conjugation by S(n — 1) if they both have the same cycle type, and the 
cycles containing n have the same length. Thus the conjugacy classes with respect to 
conjugation by S(n — 1) can be parameterized by pairs (J, p) where j takes values from 1 
to n, and p is a partition of n — j. Suppose we adopt this parameterization, and suppose 
that a permutation ir is an element of the conjugacy class (j,p)- If this permutation is 
written as a product of disjoint cycles, then the cycle containing n has length j, and 
p represents the remaining cycles. By simple combinatorial arguments we find that the 
number of permutations in the conjugacy class parameterized by (j,p) is equal to ^"J 1 ^ , 
where 

z p = Y[i mi mil 

i>l 

and rrii = mj(p) is the number of parts of p equal to i. 

Alternatively, S(n — l)-classes in S(n) can be parameterized by a partition of n with 
a marked row. Let tt be a permutation from S(n) which has the cycle type p. Suppose 
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the permutation tt is written in terms of cycles, and the number n is contained in a cycle 
of length k, 1 < k < n. Then we mark the lowest row of the partition p which has 
the length k. For example, the permutation (127) (45) (36) belongs to the conjugacy class 
with respect to conjugations by S(6) which can be parameterized either by the marked 
partition (3*, 2, 2), or by the pair p = (2,2) and j = 3. It is evident that each marked 
partition corresponds to a pair p,a f p, where a is obtained from the marked partition p 
by removing one box from the marked row. Thus, the marked partition (3*, 2, 2) can be 
represented by the following pair of Young diagrams: p = (3, 2, 2) and a = (2, 2, 2). This 
implies a one-to-one correspondence between S(n — l)-classes in S(n) and pairs (p, a f p) 
of partitions. 

As it can be readily seen from the properties of the generalized characters listed in 
Section [2.41 the generalized characters are constant on conjugacy classes with respect to 
the conjugation by the subgroup S{n — 1). Thus in the tables of generalized characters 
the rows (generalized characters) and columns (conjugacy classes) are indexed in the same 
way. For the cases of 5(3), 5(4) the tables of normalized generalized characters can be 
obtained directly from Definition 12.3.11 

Degree 3 







Class 


(3*) 


(2,1*) 


(2*,1) 


(1,1,1*) 










Order 


2 


1 


2 


1 












2 


2 


2 


2 












-1 


2 


-1 


2 










r( 2 v) 


-1 


-2 


1 


2 












2 


-2 


-2 


2 














Degree 


4 












Class 


(4*) 


(3,1*) 


(3*,1) 


(2,2*) 


(2,1,1*) 


(2*, 1,1) 


(1,1,1,1*) 


Order 


6 


2 


6 


3 


3 


3 


1 


r (4") 


6 


6 


6 


6 


6 


6 


6 




-2 


6 


-2 


-2 


6 


-2 


6 




-2 


-3 


1 


-2 





4 


6 


r (2,2*) 





-3 


-3 


6 








6 




2 


-3 


1 


-2 





-4 


6 




2 


6 


-2 


-2 


-6 


2 


6 


ru.Lun 


-6 


6 


6 


6 


-6 


-6 


6 



In the tables of the generalized characters presented above the order means the number 
of elements in the corresponding conjugacy class. 

3. A MURNAGHAN-NAKAYAMA TYPE RULE FOR THE GENERALIZED CHARACTERS 

3.1. Notation. We say that a box b in a Young diagram A is in position if b is in 
row i and column j of A. A Young tableau of shape A is a filling of the Young diagram 
A with the numbers 1,2, ... ,n. Young tableaux in which the numbers are increasing left 
to right across the rows and increasing down the columns of A are called standard. We 
denote by SYT(A) the set of the standard Young tableaux of shape A. 

The content of a box b in A which is in position in A is given by j — i. We write 
c(b) = j — i. Let T be a Young tableau with n boxes, and let A; be a number which takes 
a value from 1 to n. We denote by CT{k) the content of that box of T which is occupied 
by k. For example, if T is given by 
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1 


CO 


8 


2 


5 




4 


6 




7 





we have ct(5) = 0, cy(8) = 2, and so on. 

A skew Young diagram \/u is a border strip if it is connected and does not contain any 
2x2 block of boxes. A skew Young diagram \jv is a broken border strip if it does not 
contain any 2x2 block of boxes. Therefore, a broken border strip is a union of connected 
components, each of which is a border strip. 

We introduce the following terminology (cf. Halverson and Ram HalRam j). A sharp 
corner in a broken border strip is a box with a box below it and a box to its right. On 
the contrary, a dull box of a broken border strip is a box with no box to its right, and no 
box below it. Alternatively, a dull box can be characterized by the following property: if 
we remove a dull box from a broken border strip \/u we obtain a new broken border strip 
n/v such that /i /* A. 

The following figure shows a broken border strip with two connected components where 
each of the sharp corners has been marked with an s and each of the dull boxes has been 
marked with a d: 



d 



d 



d 



Recall (see Macdonald |Macj ) that the height of a connected component (i.e. of a border 
strip) is defined to be one less then the number of rows it occupies. We define the height 
of a broken border strip \jv as the sum of the heights of the connected components of 
X/v. We will denote the height of a broken border strip \jv by (A/z^). 

3.2. The formula for the generalized characters. 

Theorem 3.2.1. (A Murnaghan-Nakayama type rule.) Let A be a partition of n, fj, be a 
partition of n — 1, and \i be obtained from A by removing one box. Denote by r|^'^* A ', 
where 1 < j < n, and p is a partition of n — j, the value of the generalized character 
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p(A,/i/'A) a £ p ermu tations of S(n) of the cycle-type (j,p) (with respect to conjugations by 
S(n — 1) ). Then 

1 (j,p) ~ 2^ V^x/uXp 

u\-n—j 

where \ v p denotes the value of the irreducible character of S(n — j) at permutations of the 
group S(n — j) of the cycle type p, and ^>^/ v ^\/ v is a combinatorial coefficient associated 
with the marked skew Young diagram X/u (the box X/fj, of the skew Young diagram X/u is 
distinguished). This combinatorial coefficient is defined by 

(-i)<v*> n ka/m) - c(s)} n H\/»)-c(d)]-\ 

s€SC deDB 

Vli/v,\/v = \ if X/u is a broken border strip; 

0, otherwise 

where SC and DB denote the sets of sharp corners and dull boxes in X/u, respectively, 
and (X/u) is the height of X/u. 

For example, let us compute the value of the generalized character corresponding to 
A = (3,2,1) and p = (3,2) at the permutation (15)(2)(346). This permutation has the 
following cycle type: j = 3, p = (2, 1). The formula in the statement of Theorem 13.2.11 
says that r^ 3 ' 2,1 '^ 3,2 ) ((15)(2)(346)) is a sum of two terms since there are only two Young 
diagrams u with 6 — 3 = 3 boxes such that u C fj,. These diagrams are (3) and (2,1). 
Correspondingly, we need to consider contributions from two skew Young diagrams X/u, 



i i i i 

1 L. J 



-1 





-2 





and 



where the numbers in the boxes are the contents of the corresponding boxes. We note 
that the height of the first diagram is 1, and the height of the second diagram is 0. From 
the formula for the generalized characters we then find 

r (3,2,l),(3,2) (( 15 )( 2 )(346)) = 
(3) , ^ -2-j-l) (2,1), Q 1 _ 1 

*(2,D^ ' _ 2 _o +X (2,ir L > (_ 2 -0)(-2-2) 2' 

where we have used x% \\ = 1> •^(2'ij' 1 = ^' ^ ne rea der can verify that the formula for 
the generalized characters stated in Theorem 13 . 2 . 1 1 correctly reproduces the tables of the 
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generalized characters of degrees 3 and 4, see Section [2.51 (Recall that these tables were 
first obtained directly from the definition of the generalized characters, equation (|2.3.1|) .) 



4. Proof of Theorem 13.2.11 

4.1. The projection formula. A general form of a generalized character (or a spherical 
function of the Gelfand pair (S(n) x S(n — 1), diag S(n — 1)) is as follows (see Travis |lrav| . 
Brender |Brenj . Olshanski |Qlshj for more details). Suppose that A and p are any Young 
diagrams such that |A| = n, \fi\ = n — 1, and p, f A (recall that such Young diagrams are 
parameters of generalized characters). Consider the corresponding irreducible represen- 
tations p\ and Pn of the groups S(n) and S(n — 1). Let V x and be vector spaces on 
which the irreducible representations p~\ and p^ are realized. Since p^ occurs in p~\\S{n) 
with multiplicity 1, we may assume that C V x . Denote by P x the projection from V x 
onto V^. Then for any ir £ S(n) 

(4.1.1) r A '^ A (vr) = Tr [p X (n)P x 

From this projection formula it is not hard to determine the values of the generalized 
characters r A '^/" A on n-cycles. This can be done using the Jucys-Murphy elements 
X\ , Xi , . . . , X n defined by 

Xi = (li) + (2t) + ... + (« — li), i = 1, 2, . . . , n. 

In particular, X\ = 0. (The Jucys-Murphy elements were introduced independently in 
Jucys |Juj and Murphy |Murj . In the paper by Okounkov and Vershik [UkVerj the Jucys- 
Murphy elements are used to give a new approach to the representation theory of S(n), 
see, in particular, their proof of the classical formula for the values of irreducible characters 
of S(n) on n-cycles, Proposition 8.2 in Okounkov and Vershik [UkVerj . We also remark 
that in references |Ukll IOk2j , |Qlshl lUlshlj the Jucys-Murphy elements are used in the 
infinite-dimensional representation theory.) Now observe that X2X3 . . . X n is equal to the 
sum of all n-cycles in S(n). Moreover, the eigenvalue of X2X3 . . . X n on any Young basis 
vector in V x equals 

{-l) b b\(n-b- 1)! 

if A is a border strip of height b, and equals zero otherwise, see Okounkov and Vershik 
|OkVerj . Proposition 8.2. Clearly, a generalized character has the same value on each 
rt-cycle, and using the projection formula, equation 1)4.1.1(1 . we find that F x,fl /" x (12 . . . n)) 
equals 

1 dim V^ 1 

(_!).«(„_»_!),_, 

if A is a border strip, and equals zero otherwise. If A is a border strip of height b with 
n boxes, then A = (a + 1, 6), and a + b + 1 = n. Note also that if p is obtained from A 
by removing one box, and A = (a + 1,6), the following two possibilities arise. The first 
possibility is that the Young diagram p has the form (a, 6), and the second possibility is 

/ n — 2 \ 

that the Young diagram p has the form (a+1, b— 1). In the first case dimT^^ = I , j , 
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and in the second case dim = ( ^ l ) ' Therefore, we obtain 



(4.1.2) r A '^ A ((l,2,...,n)) = < 



X = (a + l,b),/j,= (a,b) 
(-1)'^, A = (o + l,6),/i = (o + l,6-l) 
0, A is not a border strip. 



It is instructive to check that the same result follows from the general formula in the 
statement of Theorem IH.2. II If we are interested in the value of the generalized character 
on the cycle (1,2, ... ,n) (i.e. in the value of T^l ^^_^), then the sum in the expression 
for the generalized characters in Theorem 13.2.11 is reduced to one term only. This term 
corresponds to the empty diagram, v = 0, and the term itself is equal to 93 m ,a- But tp^x ^ 
only if A is a border strip. (A is a Young diagram, and not a skew Young diagram. Thus 
A is necessarily connected.) Parameterizing A as (a + 1,6) and considering two possible 
cases when /i = (a, 6), and fi = (a + 1,6 — 1) we obtain the formula for the generalized 
character on the cycle (1,2, ... ,n), equation (|4,1.2j) . 

However, the derivation of the formula for the generalized characters in a more general 
situation demands an additional work. The idea is to use Young's orthogonal representa- 
tion and extend the methods of the paper by Greene |Grj to the case of the generalized 
characters. 

4.2. Application of Young's orthogonal representation. Let T be a Young tableau 
with n boxes. For each ir G S(n), let irT denote the Young tableau obtained from T by 
replacing each entry i of T by its image ir(i) under ir. Since S(n) is generated by the 
transpositions (k, k + 1) for 1 < k < n, it is sufficient for many purposes to determine the 
action of these transpositions on T. Now for each standard Young tableau T of shape A 
with n boxes, and for each transposition (k, k + 1) in S(n) we define 

A(T, k)T + B(t, k)T', if T' = (k,k + 1)T is standard; 
A(T, k)T, otherwise 

where A(T,k) = [cy(A; + l) — ct(&)] -1 and B(T,k) = \Jl — A 2 (T, k). In particular we 
have an action of the group S(n) on the vector space consisting of all R- linear combinations 
of the standard Young tableaux of shape A. Young's theorem Young| says that this is a 



p x ((k,k + l))T 



representation of S(n) which is known as Young's orthogonal representation. 
Let 7r be a permutation of S(n) which is in the standard form: 

ir = (1,2, ... , ai)(a 1 + l,...,a 1 + a 2 )... (b K -i + l,...,b K ) 

where {ai,a 2 , ■ ■ ■ ,ax} is the cycle-type of the permutation %, and we have written 6, = 
a\ + . . . + cii for i = 1,2, ... ,K. For every Young tableau T of shape A with n boxes, and 
for every permutation tt of S(n) which is in the standard form we set 

A 7r (T)= H A(T,j). 

j^bi,b 2 ,...,b K 

It turns out that the diagonal entries of the matrices in the Young orthogonal representa- 
tion can be expressed in terms of A n (T). To present an explicit formula let us introduce 
a linear order on the set SYT(A) of the standard Young tableaux of shape A. Namely, if 
Ti and Tj are such that the largest disagreeing number occurs in a lower row in Tj, than 
Tj we say that Tj precedes Tj in the ordering. This is known as the last-letter ordering of 
tableaux. For example, if A = (2, 2, 1) then the last-letter ordering is 
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1 


4 


2 


5 


3 





< 



1 


CO 


2 


5 


4 





< 



1 


2 


3 


5 


4 





< 



1 


CO 


2 


4 


5 





< 



1 


2 


3 


4 


5 





With these notations we have 

(4-2.1) (pa(t)) m = A w (Ti). 

The proof is based on Young's orthogonal representation (described above in this Section). 
For details see Greene |Grj . Lemma 2.4 and Ratherford Rut li . page 43. 

Formula (|4.2.1|) says that in order to compute the irreducible character of S(n) parame- 
terized by the Young diagram A we need to sum up the right-hand side of equation (|4,2.1j) 
over the set SYT(A) of all standard Young tableaux of shape A with n boxes. On the 
other hand, the generalized character parameterized by the pair of the Young diagrams A 
and /X is given by the projection formula, equation 1)4.1.1(1 . This formula implies that the 
generalized characters can be represented as sums over certain subset of SYT(A). Denote 
this subset by SYT(A, fj,). It is clear what SYT(A, fi) is. It consists of all standard Young 
tableaux of the shape A such that the number n occupies the box X/fJ,. Therefore we 
obtain 

(4.2.2) r (A,M/A)^ = £ A W {T). 

T€SYT(A,m) 



4.3. The generalized characters as sums over sequences of Young diagrams. Let 

A be a Young diagram with n boxes, and /U f A. Let v be yet another Young diagram such 
that v C. [I. Suppose that the number of boxes in the skew Young diagram X/v equals m. 
We set 

a(xm = J2 1 



\ct(2) — cx(l)l • • • \cT{m) — ct{vtl — 1)1 

Tg SYT(A/V) WJ v n 



and 

A^/v;X/p) = 



, SVT(/ , ;/) [Pr(2) - c T (l)] . • • [c T (m - 1) - c T {m - 2)] [c(A//x) - c T (m - 1)] ' 

Proposition 4.3.1. Let tt be a permutation of S(n) which is in the standard form, ir = 
(1,2,..., ai)(ai + 1, . . . , ai + 02) ■ ■ ■ ipK-i + 1, • • • i bx), where {0,1,02, • ■ ■ , ax} is the cycle 
type of tt and bi = a\ + . . .+Oj for i = 1, 2, . . . ,K. Then formula \4-2.^j) for the generalized 
character T^'^^^ (tt) can be rewritten as 

(4.3.1) r A ^ A (vr) = Y, A(Ai)A(A 2 /Ai) . . . A(X K - 2 /XK-i)A(ji/X K -i\ X/X K ~i) 

s 

where the sum is over all sequences S of Young diagrams X±, A2, • • • , Xk-i such that 

C Ai C ... C A^_! C n, 

Xi/Xi-i is a skew diagram with ai boxes for any i from 1 to K — 1, Ao = 0, and h/Xk-i 
is a skew diagram with ax — 1 boxes. 
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Proof. As it is clear from the definition of A^(7r) (see Section f4. 2(1 formula (|4.2.2|) for the 
generalized character T^ X '^-^^ (tt) can be rewritten explicitly as follows 



r<wx)( T ) 



E 

TeSYT(A,^) 

n 



if i 

c T(n + i)-c T (ji 

1 



n 



bi<jz<b2 



_j CT(j2 + 1) - C T (j2) 



cr(jtf + 1) - c T (j K ) 

J>k-i^3k^o k — 1 

In this formula we collect the terms according to positions occupied by various segments 
of numbers {1,2,..., a±}, {a± + 1, . . . , a± + 02}, . . . , {bK-l + 1, ■ • • , n — 1}, and obtain 



r (WA)( 7r)= ^ 

0CAiC...CA K _ 1 C^ 1 



1 



E 



y n 

r, E s^(A 1 )i<ji<i,-i <T ' (j ' 1 + 1) " CT ' (j ' 

n 



T fe _iGSYT(A K _ 1 /A K _ 2 )6jf_ 2 +l<Jjf-i<6K- 



X 



-1 PTk-iOk-I + !) - OTjc-iCjJC-l) 
1— 1 



1 



cr K (jA- + 1) - ctkUk) 



e n 

_T fc eSYT( At /A K -i,A/A A '_ 1 )bA--i+l<jA-<feA--l 

where the sum is over Young diagrams Ai, . . . , \r-i with 61, ... , bic-i boxes correspond- 
ingly. Now we use the fact that the products above make sense if the tableaux (or skew 
tableaux) have values in any ordered set, and these products depend only on the positions 
and the linear order of symbols. This enables us to rewrite the product in the sum over 
sequences of Young diagram as 

A(A X )A(A 2 /Ai) . . . A(Aa-_2/Ajc_i)A(/VAk-_i; \/X K -x) 
which gives the formula in the statement of the Proposition. □ 



Formula 1)4.3. 1|) leads us to a Murnaghan-Nakayama type rule for the generalized char- 
acters r A '^/' A provided explicit formulae for A(X/u), A(^/V; \/v) are determined. At this 
point we turn again to the work of Greene |Gr| . Working in the case of irreducible charac- 
ters of S(n) (or spherical functions of the "balanced" Gelfand pair (S(n) x S(n), diag S(n)) 
Greene suggested an approach to compute A(X/u). The next section reproduces these 
computations. 

4.4. Computation of A(A/i/). In this Section X/v denotes a skew Young diagram with n 
boxes. Following Greene jGrj . we fix a standard labelling of the boxes of the skew Young 
diagram X/v. By a standard labelling we mean the one which labels boxes in a skew 
Young diagram from left to right in each row, beginning with the first row. For example, 
if A = (3, 2, 2, 1), v = (1, 1) the standard labelling of the skew Young diagram X/v is 





1 


2 




3 




4 


5 




6 
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Once the standard labelling is introduced we can regard each standard Young tableau 
T of shape X/u as a map T : {1, 2, . . . , n} — > {1, 2, . . . , n}. This map is defined by the 
condition that T(i) (the value of T at an element i of the set {1, 2, . . . , n}) is equal to the 
entry of the box labelled by i in the standard tableau T. For example, if the standard 
tableau T is 





1 


5 




2 




4 


6 




3 







then the map T : {1,2,3,4,5,6} -> {1,2,3,4,5,6} is defined by T(l) = 1, T(2) = 5, 
T(3) = 2, T(4) = 4, T(5) = 6, T(6) = 3. 

Let x\,X2, ■ ■ ■ ,x n be indeterminates, and assign to each skew Young diagram with n 
boxes a rational function constructed with indeterminates X\,X2, ■ ■ ■ ,x n . Namely, if X/u is 
a skew Young diagram with n boxes we assign to X/u a rational function X X i v (xi, X2, ■ ■ ■ , x n ) 
defined by 

X x/u (xi,x 2 ,...,x n ) = S2 T 1 — "7 T- 

Te SYT(A/ V ) ^ T_1 ( 2 ) " S r-i(l)J • • • ^T-i(n) " Z T -i(„-l)J 

It is not hard to figure out how this rational function is related with A(X/u). Indeed, 
, X2 , • • • , X n ) is a sum of terms, and each of these terms corresponds to a standard 
Young tableau of shape X/u. Suppose that in each such term we replace the indeterminates 
xi, x 2 , ■ ■ ■ , x n by positive integers which are contents of boxes of the Young diagram X/u. 
Namely, assuming the standard labelling of X/u we replace xi by the content of the box 
labelled by 1, X2 by the content of the box labelled by 2, and so on. Under such a 
replacement the rational function X\i v {x\, X2, ■ ■ ■ , x n ) is converted into A(X/u) as it is 
clear from the definition of A(X/u), see Section f4. 31 

The above consideration shows that the problem of computation of A(X/u) can be re- 
duced to that of finding of an explicit formula for the rational function X x i v {xi , X2, ■ ■ ■ , x n ) . 
Here we present a rational-function identity for X\/ u (xi,X2, • • • , x n ). This identity is one 
of the central results of the paper by Greene |(irrj . 

Let us introduce a tableau T x / U (xi, . . . , x n ) of shape X/u, obtained by inserting the 
indeterminates xi,X2, ■ ■ ■ ,x n according to standard labelling of X/u. For example, if 
A = (3,2,2,1), u = (1) then T x/u is 





Xi 


x 2 




Xi 






Xq 




X 7 







Theorem 4.4.1. If X/u is a connected skew Young diagram, the following rational- 
functional identity holds 

x , x . _ T\p x/ „( x j - x i) 
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where D\ denotes the set of pairs Xi, Xj with i < j which are adjacent in some diagonal in 
Twj,(xi, . . . , x n ), R\/ v denotes the set of pairs adjacent in some row of T\/ U (x\, . . . ,x n ), 
and C\j v denotes the set of pairs adjacent in some column oj 'T\/ V (x\, . . . ,x n ). 
If X/v is disconnected, X\/ V (xi, . . . , x n ) = 0. 



For example, if A = (3, 2, 2, 1), v = (1), then Theorem 14.4. II asserts the following expres- 
sion for Xx/ U - 

x = 06 ~ ga) 

X/u {xq - X A )(x A - xi)(x 7 - x 5 )(x 5 - x 3 ) ■ (x 2 - xi)(x 4 - x 3 )(x 6 - x 5 ) ' 

The relation between the rational function X\/ v and A(A/V) (described above in this 
Section) provides us with a formula for A(A/z^). Namely, 



(4.4.1) A(A/i/) 



(— l) <A//l/> , \jv is a border strip, 
0, otherwise. 



One of our objectives in the following study is to find an analogue of the last written for- 
mula for l\(fi/v,\/v) introduced previously in Section EP1 If a formula for A(/i/V, \/v) 
is granted, we could obtain an explicit expression for the generalized character r A, ^/' A , as 
it is clear from equation (|4.3.1j) . In order to compute A(n/u, X/u) we introduce a function 
X\/ U)fl / U (xi, X2, • • • , x n ), and derive a rational-function identity for X x / Ujfl / U (xi, x 2 , • • • , x n ). 

4.5. A rational-function identity related with A([i/v, A/V). Let v C /_i c A, X/v be 

a skew Young diagram with n boxes, fi/u be a skew Young diagram with n — 1 boxes, and 
H y X. As in Section we fix the standard labelling of the boxes of X/v. Suppose a box 
A//i is labelled by number 1(A///) under this standard labelling. We can now regard each 
standard Young tableau T of shape [i/v (filled by numbers 1, 2, . . . , n — 1) as a map 

T: {l,2,...,l(A/^)-l,l(A//i)+l,...,n}^{l,2,...,n-l}, 

where T(j) is the entry in the box labelled by j in the standard tableau T of shape [i/v. 
For example, if A = (2, 2, 1), fi = (2, 1, 1), and v = (1) we fix the following labelling 



3 i 



(where the box X/fi labelled by 3 is distinguished). Then the three standard Young 
tableaux of shape [i/v, where [i = (2, 1, 1) and v = (1) can be understood as follows. The 
tableau 





1 


2 




3 





corresponds to the map T : {1,2,4} -> {1,2,3}, under which T(l) = 1,T(2)=2, T(4) = 3; 
the tableau 
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2 


1 




3 





corresponds to the map T : {1,2,4} -» {1,2,3}, defined by T(l) = 2,T(2)=1, T(4) = 3; 
and the tableau 





00 


1 




2 





can be understood as the map T : {1,2,4} — ► {1,2,3}, under which T(l) = 3,T(2)=1, 
T(4) = 2. 

With this understanding of the standard Young tableaux of shape \i/v we define an 
algebraic expression with indeterminates xi,x 2 , . . . ,x n . Namely, to the pair of the skew 
Young diagrams X/u and fi/u we assign the rational function 

(4.5.i) x XMv (x u ...,x n )= jz — r~r; ; r 

For example, if A = (2,2,1), \i = (2,1,1) and u = (1) the right-hand side of the latest 
written expression takes the following form: 

1 1 1 

(x 2 - Xl)(x 4 - X 2 )(x 3 - Xi) (Xl - X 2 )(x 4 - Xl)(x3 ~ Xa) (xa ~ X 2 )(xi - X 4 )(x 3 - X\) ' 

We recall that IaWi/^Ii • • • ■> x n) was introduced with the purpose to compute A(fi/u, X/u) 
included in the formula for the generalized characters T x,fl/ ^ x , see equation (|4.3.1I) . It fol- 
lows from the definition of A(/i/z/, X/u) that if we replace the first argument of X X / V ^/ V , 
xi, by the content of the box X/u labelled by 1, the second argument of X x i Vtll i v , x 2 , by 
the content of the box X/u labelled by 2, etc, we obtain A(fi/u; X/u). 

Now we observe a relation between X x i v {xx, . . . , x n ) introduced in the previous Section, 
and X X / u ^/ u {xi, ... ,x n ). Namely, we have 

X X / u (Xl, ■ ■ ■ , X n ) = y J n r T 

TG SYT(A/ V ) - 3>r-i(l)J • • • L»T-i(«) - VT-Hn-1)\ 

= V V - . 

H/XTe SYT^/u) [ X T-\2) ~ X T -1 (1) ] . . . [x 1(A//i) - ^T-i(n-l)] 

(The last written expression is obtained if we decompose the set SYT(A/z^) into different 
subsets parameterized by Young diagrams /i such that \i /* X. Each such subset includes 
standard Young tableaux of shape X/u with n boxes, and is characterized by the property 
that the number n occupiers the same box, X/fJ,, at each tableau.) We can also rewrite 
the second expression for X x / U)/JL / V (xi, . . . , x n ) using the definition of X x i v ^i v {xi, . . . , x n ), 
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which gives 

(4.5.2) X x/u (x 1 ,...,x n ) = ^2x x/U)fl/u (x 1 ,...,x n ). 

Moreover, by a similar consideration we can find a recurrent relation for Xx/^^/ u (x\, . . . , x n ). 
Indeed, 

X\/ v ^/v{ x li ■ ■ ■ i x n) = 2j 7 1 f T 

Te S^/u) i S r-i(2) " *T-i(l)J • • • [ x l(X M " ST-i(n-l)J 

(4.5.3) = H 2 



T/^Te SYT( 7 /i/) N-i(2) " iT-i(l)] ■ ■ ■ [^Wt) ~ X T~^n-2)] [ X \(X/^) " ^/t)] 
^ x \(\/n) ~ x l( P h) 

where it is assumed that /i 2 7 2 K/Vt) i s the label of the box fi/'y under the stan- 
dard labelling, and in the last expression Xu\/n) means that XuxU) ls removed from the 
arguments of X^/ u ^/ u . 

The above recurrent relation gives us a convenient way to represent X\/ V {x\, . . . , x n ) 
and Xpi v \/ V (xi, . . . , x n ) graphically. For example, we can find explicit expressions for 
X( ?h i)(x 1 ,x 2 ,x 3 ,x 4 ), X^^i) (xi,x 2 ,x 3 ,X4), and X {3jl ) i(3 )(xi,x 2 ,x 3 ,X4) using the pic- 
ture below (see Fig. 1). 




iXl I 



iXl I 



IXl I 



From this picture (which is just a graphical representation of the corresponding recurrent 
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relations, see equation Q4.5.3|) ) we find 

111 111 

X(3 t l){xi,X 2 ,X 3 ,X 4: ) = — = = = h 



+- 



2 3 — X4 X4 — X2 X 2 — X\ X 3 — X 2 X 2 — X4 X4 — X\ 
1 1 1 



X4 - X 3 X 3 - X 2 X2 — X1 



x (3,l),(2,l){xi,X2,x 3 ,X4) = — h 



X 3 — X4 X4 — X2 X2 — X\ X 3 — X2 X2 — X4 X4 — X\ 



X(z,l)^)(xi,X2,Xz,X4) 



X4 - X 3 X 3 - X 2 X 2 - Xi 



and X( 3il )(xi,X2,X3,X4) = ^(3,1), (2,1) ( X l> X 2, X 3 , X4) + ^(3,1), (3) ( x li x 2, X 3 , Xi). 

Now we are in a position to give a rational- functional identity for X\i v ^i v {xx, . . . , x n ). 
It will be clear from the subsequent considerations that for our purposes it is enough to 
consider the situation when X/v is a broken border strip. Let {di, . . . , d m } be the labels 
of the dull boxes of the broken border strip \jv. (Recall that we assume the standard 
labelling of Young diagrams introduced in the beginning of Section l4.4|h We note that 
one of the numbers from the set {di, . . . , d m } labels the box A///. Suppose this number is 
di, where the index i takes some value from 1 to m. Let {s±, . . . , si} be the labels of sharp 
corners of the broken border strip X/u. Both these sets, {d%, . . . , d m } and {si, . . . , s;}, 
are subsets of the set {1,2, . . . ,n}, where n is the number of boxes in X/v. Recall that 
T\/ V (xi, X2, ■ ■ ■ ,x n ) is a tableau of shape X/v obtained by inserting the indeterminates 
X\, . . . , x n according to the standard labelling of X/v. 

Theorem 4.5.1. If X/v is a broken border strip, then 



1 

EI (xdi ~ x s ) 



X\/u,ii/v i x l ) • • • 3 x n ) 



i=i 

where C\/ v denotes the set of pairs Xi,Xj with i < j which are adjacent in some column of 
T\/ U (xi, . . . , x n ), R\/ u denotes the set of pairs Xi,xj with i < j which are adjacent in some 
row of T\/ V (x\, . . . ,x n ), Xd x , ■ ■ ■ ,Xd m are indeterminates associated with the dull boxes of 
T\/ U (xi, . . . , x n ), and x Sl , . . . , x Sm are indeterminates associated with the sharp boxes of 
T\/ V {x 1 , . . .,x n ). 



For example, if the tableau T\/ v is that pictured below, 
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Xl 


X2 


%3 


X4 





XlO 



X13 



X U 



xn 



x\s 



xiv 



X15 



;r 9 



X\2 



£16 



•1'6 



x 7 



x 5 



X8\ 



and the box corresponding to X/fi is occupied by x$, Theorem 14.5.11 gives the following 
expression for X x/l/ ^ /u : 



(x s - X!)(X 8 - x 13 ) 



1 



(x s - x A ){xg - xm)(xg - x w ) (x 3 - x 2 ){x 2 - Xi)(xg - x 7 )(x 7 - x 6 )(xi 6 - x 15 )(xi 5 - xu)(xu - ar 13 ) 

1 



(24 - xi)(x 8 - x 5 )(xi e - xi 2 )(xi2 - xii)(x n - xioH^io - x 9 )(x w - xi 8 )(xi$ - xi 7 )(xi 7 - xi 3 ) ' 



Proof. The proof of the rational-functional identity for X\i v ^i v is by induction. In the 
situation when X/v is a broken border strip with two boxes, the asserted identity can be 
checked directly using the definition of the algebraic expression Zw^, equation (|4.5.1|) . 
Assume that the asserted identity holds for every broken border strip which consists of 
n — 1 boxes. We are going to show that this assumption implies the asserted identity for 
every broken border strip consisting of n boxes. To this end consider all Young diagrams 
(jbi, H2, ■ ■ ■ , A*fc such that fi\ /* ^^2 / fi, ■ ■ ■ ,f.ik S M- Let d[, . . . , d' k be the labels of 
the boxes n/fJ>i, fJ>/fJ>2, ■ ■ ■ , n/Hk-, respectively (once again, the standard labelling of [ijv is 
assumed). With these notations the recurrent formula for X x / V ^/ P derived previously in 
this Section can be rewritten as 



(4.5.4) 



X\/ V ^/ V {xi, ... ,x n ) = y 



g=l 



Xdi ~ x d > 



■^■fi/u,fj, q /u{xi > • • • > X^ j ■ ■ ■ j Xn). 



Clearly, the boxes labelled by d' t , d' 2 , ■ ■ ■ , d' k are in fact the dull boxes for the skew Young 
diagram fi/v. Denote by s' 1; s' 2 , ■ ■ ■ , s' the labels of the sharp corners of the skew Young 
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diagram fj,/ v. The assumption for the case of n — 1 boxes provides us with a rational- 
functional identity for X^/ U ^ q / U {x\, . . . 

; x di i • • • t x n ) ■ 



n ( x d> - x s 



x. 



fj,/u,fi q /u\^l ) • • • ; X di j • • • ) X r . 



3=1 



n ( x d' q - x d > 

3=1 3 
3+1 



n 



x i) lie,,/,, ( X 3 x i 



Insert this expression to the recurrent formula (equation 14.5. 4jl and obtain: 



X\/v,ij,/u { x l ) • • • j x n) 



£ 

1=1 



tl( x d' q -av.) 
3=1 3 



Xd; ~ x d > 



n ( x d> - x d>) 

3=1 3 
3+1 



n 



R 



C j X i)Y\c ti/v ( X 3 X i 



In order to simplify the expression in the brackets apply the well known algebraic identity 

^ k 



(z-xi)...(z- x m ) 
{z-yi)...(z- y k ) 



1 UiLiivi - x i) 



which gives a rational- functional representation for X\j v ^/ V : 



VjJ 



X 



\/u,)i/u { x l > • • • 1 x n) 



\[{ x <k 

3=1 



no** 

3=1 



x d' A 



x i)T\c^ /v (. x 3 x i) 



It remains to show that the last written expression actually coincides with that in the 
statement of the theorem. To check this consider two different possibilities, 
a) The first possibility is that the broken border strips \/v and \xjv have the same set 
of sharp corners. Then the numerator in the last written expression is exactly the same 



as that in the formula for X 



in the statement of the theorem. If this possibility is 



realized it can happen, however, that the skew Young diagrams \ jv and ii/v have different 
dull boxes. If it is so suppose that the dull box of fi/u labelled by dj is not a dull box 
of X/u. Then the corresponding term, (x di — x d r), can be joined to one of the products, 



n 



Xi 



or n 



C, 



-Xi). (Note that the boxes labelled by di and d' are adjacent 



to each other. Indeed, the box labelled by d'- can be situated either just above the box 
labelled by di or just left to the box labelled by di. Thus di > d'j.) Therefore one can 

m 

■ Xdi ) Ur, ,„ (xj - Xi) He, ,„ ( x 3 ~ x i)' and if the broken 



rewrite the denominator as \\ (x d . 

3=1 

3+i 

border strips \jv and ji/v have the same set of sharp corners we are done, 
b) If the second possibility is realized, i.e. the number of sharp corners of n/v is less then 
that of we note that there exists a label Sj which does not coincide with any labels 
s'i, s 2 , . . . , s' p . In this situation multiply the numerator and the denominator by {x di —x Sj ), 
and after that, in the denominator, join this multiplier, {x di — x Sj ), to one of the products 
n_R ( x j ~ x i) or Tic ( x 3 ~ x i)- (Note that the box labelled by Sj can be situated either 
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just above the box labelled by di, or just to its left. In any case dj > Sj). Therefore the 
situation which arises when the second possibility is realized can be reduced to the case 
considered in a) (when the broken border strips Xjv and fj,/v have the same set of sharp 
corners.) □ 

4.6. Computation of A(fj,/v, X/v). The results of the previous Section enable us to 
compute A{n/v, X/v), and thus to derive a formula for the generalized characters. Let us 
first prove the following 

Proposition 4.6.1. Let Xjv be any skew Young diagram containing a 2x2 block of boxes 
(which means that X/v is not a broken border strip). Then A([i/v } X/v) = 

Proof. The proof is by induction, and it is based on an application of the following rela- 
tions: 

(4.6.1) 0=^A0i/i/,A/i/), 

(4.6.2) A(p/u, X/v) = Y TV, \ 1 (iy A ^/ u > v/v) 

fj! c[X/n) - c(/i/7) 

(The first relation follows from the fact that A(X/v) = 0, if X/v is not a broken border 
strip, see equation (|4.4.1|) . and from the relation between algebraic expressions X\j v and 
X\/ V) ^/ v , equation (|4.5.2|) . The second relation follows from equation (|4.5.3|l .) 

Assume that the assertion is valid for all skew Young diagram X/v with n — 1 boxes. Let 
us prove that this implies the validity of the assertion for the case of skew Young diagrams 
with n boxes. 

a) If A/f includes a 2 x 2 block, and n/v contains a 2 x 2 block (where fi /* A), then 
A(7 /v, n/v) = for all 7 /" \i (assumption for n — 1), and A(/i/V, \/u) = as it follows 
from equation (|4.6.2j) (all terms in the sum in the right-hand side of equation (|4.6.2jl are 
zeros). 

b) It remains to consider the case when the skew Young diagram under consideration, 
X/v, includes one 2x2 block, but the skew Young diagram \ijv does not include any 2x2 
blocks. Then equation 1)4.6. 1JI gives 

= A(fx/u,X/u)+ Y, A(A/i/,7/f). 

Now, by a), all terms in the sum over Young diagrams 7 in the right-hand side of the 
equation above are zeros since all diagrams 7/z/ must include a 2 x 2 block of boxes (the 
same 2x2 block which is included in Xjv). Therefore A(A/V, n/v) = 0. □ 

Proposition 4.6.2. If Xjv is any skew Young diagram, then 

{ (-i) <A/iy> n wa/m) - <s)\ n ic(x/»)-c(d)]-\ 

sesc deDB 
if X/ ji is a broken border strip; 

0, otherwise; 



A(ji/v, Xjv) 



where SC and DB denote the sets of sharp corners and dull boxes in Xjv, respectively, 
and (X/v) is the height of Xjv. 
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Proof. The formula for A(fj,/u, X/v) stated in the Proposition follows immediately from 
the relation between A(fj,/v, \/v) and Xx/ U ^/ U} and from the explicit formula for X\/ U ^i v 
(Theorem gXU). □ 

5. Modules C and A[t] 

5.1. The ring C. Let S{n) be the group of permutations of the set {1, 2, . . . , n}. Denote 
by C(n) the space of (complex valued) functions on the group S(n) invariant with respect 
to conjugations by the elements of S(n). (Thus C(n) is the space of central functions on 
S(n)). 
Let 

C = C(n), 

n>0 

with the understanding that C(0) = C. We embed S(m) x S(n) in S{m + n) in such a way 
that S(m) is the group of permutations of the first m elements in the set {1, 2, . . . , m + n}, 
and S(n) is the group of permutations of the subsequent n elements. 

Let / G C(m), g G C(n), and we define a bilinear multiplication C{m) x C{n) —* 
C(m + n) by the formula 

(5-1-D /•5 = ind£+% ri) (/x 5 ). 

More explicitly, for any tt G S{m + n) 

(/•ffXO = rg7 ^7 v] J" 

6(m) 6(n) s 

1 V /M V 7 aG5(m+n) 

with the understanding that (/, g) is concentrated on S{m) x S(n), i.e. 

/(•7ri)#(7r 2 ), o- _1 7ro- = 7T17T2, 7Ti G S'(m), 7T 2 G ^(n); 



(/ x g)(a na) 



0, otherwise. 



Thus / • g is an element of C(m + n), and with this multiplication C is a commutative, 
associative, graded ring with an identity element. 

5.2. The module C over C. Suppose S(n — 1) is the subgroup of S(n) realized as 
the group of permutations of the set {1,2, ... ,n — 1}. Denote by C'(n) the space of 
(complex-valued) functions on S(n) invariant with respect to conjugations by elements of 
the subgroup S(n — 1) of the group S(n). We agree that 5(0) = {e}, and set 

a = C\n). 

n>l 

Let us embed S(m) x S(n) in S{m + n) as in S 15.11 Let / G C(m), and g G C'(n). We 
define a bilinear map 

C(m) x C'(n) -» C'(m + n) 

by the formula 

<5 ' 2A> (/ ^ )W= |5(,„)||S(„-l)| ^ (/x 

a<=S(rn+n— 1) 

where 7r is an arbitrary element of the group 5(m + n), and (/ x g) is concentrated on the 
subgroup S(m) x S(n) of S^m + n). With this bilinear map C is a module over the ring 
C. 
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5.3. The module A[i] over A. Isomorphism between C and A[t]. As it is well 
known the ring C is isomorphic to the ring of symmetric functions A. This isomorphism 
is given by the characteristic map, see Macdonald |Macj . I, §7. 

Let A[t] be the set of polynomials in t whose coefficients are elements of A. Clearly, 
A[t] can be understood as a module over the ring A. We aim to construct an isomorphism 
between C and A[t]. 

Let w be an element of S(n), and suppose w belongs to a conjugacy class (with respect 
to the conjugations by S(n — 1)) parameterized by the pair (j, p). Here j takes values from 
1 to n, and p is a partition of n — j. 

We then define a mapping tp : S(n) — > A[t] as follows 

(5.3.1) = 1P- X PP 

th 

where p p = p pl p P2 ■ ■ ., and is A; power sum. Next we define a mapping 

ch' : C -> Aft] 
in the following way: if 5 € C'(n), then 

(5.3.2) ch '( 5 ) = _L^ £ <?(«#H- 

We note that if g(j :P ) is the value of g at the conjugacy class parameterized by (J,p), we 
obtain 

n 

(5-3.3) ch'( 5 ) = ^^- 1 ^ 9(j,p)Pp 

j=l Xrn—j 

where z p = n«>i « m< Wj!) = Trii(p) is the number of parts of /) equal to i 
We call ch'(/) the characteristic of /, and call ch' the characteristic map. 

Proposition 5.3.1. The characteristic map ch' is an isomorphism between the C -module 
C and the A-module A[t]. 

Proof. It is enough to show that for every m > 0, n > 1, and for every / £ C(m), g G C'(n) 
the following formula holds: 

ch'(/ * g) = ch(/) • ch'( 9 ) 

where ch(/) is defined as in Macdonald |Macj . I, §7. 

The left-hand part of this equation is given by formulas (|5.2,1[) . ()5.3.2|) . Using the 
fact that ip(w) is constant on conjugacy classes defined with respect to conjugations by 
S(n — 1), we rewrite ch'(/ * g) as follows 

A ' (/ "> = |5(m)||i( B -l)| S C/,«)(«W-). 

Since (/ x g) is concentrated on the subgroup S(m) x 5(n) of the group 5(m + n) we can 
rewrite the expression above as a double sum: 

1 V /M V ;l <reS(m) 7rGS(n) 
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Suppose 7r G S(n), a € S(m), it has the cyclic structure (j,[J-), where 1 > j > n, /i is a 
partition of n — j, and <r has the cyclic structure A. Then the permutation a ■ tt has the 
cyclic structure (j, AU/j), and we obtain: 

Let f\ be the value of f\ on the permutations of S(m) with the cyclic structure A, and 
be the value of g on the permutations with the cyclic structure (j, fi). Then the 
expression for ch'(/ * g) can be rewritten as 

ch'(/ * 5 )= 53 z a Vapa j I 53 53 ^v -1 ^^ 

\Ahm / \ j=l fihri.—j 

i.e. ch / (/*< 7 ) = ch(/)-ch / ( 5 ). □ 

5.4. Scalar products on C and Aft]. Let f,g € C, say f = Yl fn an d 9 = Yl9n with 
/n,&£ C"(n). We set 

(/,#) = 53 (f n >9n}' S (n) 
n>l 

where 

(fn,9n)'s(n) = / _ jT] 53 /n(™)Sn(u> _1 ). 

This defines a scalar product on C". We now define a scalar product on Aft], i.e. a C-valued 
bilinear form (u,v), by requiring that the elements of the basis {t k p\} of Aft] satisfy the 
following orthogonality relation: 

(5.4.1) (*W^) = ^V 

Proposition 5.4.1. The characteristic map ch' is an isometry, i.e. for any f and g in 

C\n), 

(5-4.2) (cW(f),ch'(g)) = (f,gy s{n) . 

Proof. We rewrite the left-hand of equation Q5.4.2|) explicitly using formula (|5.3.cS|) . Ap- 
plying the orthogonality relation for the elements of the basis {t k p\} ( equation 15.4.1)) we 
obtain 

n 

(cr/(/),ch'(#)) = 53 53 z x l f{k,\)9(K\) 

k=l Ahn— fc 

Clearly, the right-hand side of this expression can be rewritten as (f,g)'s( n )- '— ' 

6. The generalized Schur functions 

6.1. Definition of the generalized Schur functions. Let A be a partition of n, \x be 
a partition of n — 1. Suppose \i is obtained from A by removing one box. Thus we have a 
pair (A, /j, /* A) of partitions. Recall that the generalized characters are parameterized by 
such pairs. 

Definition 6.1.1. Let r x,fl ^ x be the generalized character associated with the Gelfand 
pair (S(n) x S(n — 1), diag S(n — 1)). The image S x,fJ-// ' x of r A ' At /' A under the characteristic 
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map ch' is called the generalized Schur function associated with the Gelfand pair (S(n) x 
S(n-l),diagS(n-l)). Thus 

(6.1.1) s x '^ x = ch'(r A -^ A ). 

6.2. Orthogonality. Since the map ch' is an isometry, and the generalized characters 
satisfy the orthogonality condition 

I Sin) dim A 

(where n = |A|) it follows that the generalized Schur functions are orthogonal with respect 
to the scalar product on A[t], Namely, 

(6.2.1) / S X '^ X , S^Sp) = n ^±5 X >P5 V ^. 

\ I dim A 



Proposition 6.2.1. We have 

(t;x 1 ,x 2 ,...)S X ^ X (t;y 1 ,y 2 ,...) = - ,} ; 



(6.2.2) £ -- 1 ^^ WA (^i^2,.0^ A (t; y i, y2 ,..0 = r ^ TT - 7 ^ 

where n = |A|. 

Proof. By (ln~2~Tj) . (S X '^ X ) and (n -1 *^ • S x ^ x ) are dual bases of A[t] for the scalar 

product (/, g) defined by formula (|5.4.1|) . (t k p\) and (z^~ t k p\) are dual bases as well. It 
follows (cf. Macdonald [Mac] . I, §4, (4.6)) that 

E n_1 dSr 5A ' M/A(t; Xli X2 > • • WA (*; yi, 2/2, • • •) = E * k z?px(*i,*2, ■ ■ -)px(yx,y2, 

X,n/X k,X 

1 1 



□ 

6.3. Frobenius type formula. Now we obtain an analogue of the Frobenius formula for 
the generalized characters. We have from 1)6.1.1(1 and ()5.3.3(l 

n 

(6.3.1) S x ^ x = ch'(r WA) = £ t j-l J- z- x T^ x ■ Pp 

j=l p^n-j 

where r,!^ is the value of T X ' IM//X at elements of cycle-type (j,p)- Hence 



L U,p) -\ b >t Pp 



i.e. the transition matrix between the bases (S x,fJ-/ ^ x ) and {P 1 p p ) is the table of the 
generalized characters. Thus 

(6.3.2) ti- x p p = E T X i^ X S x ^ x 

X,p/X 

where the sum is over all partitions A of n, and partitions \i of n — 1 such that ji /* A. 
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6.4. Formula for the generalized Schur functions. The Murnaghan-Nakayama type 
rule for the generalized characters enables us to give an explicit formula for the generalized 
Schur functions. 

Theorem 6.4.1. Let X be a partition of n, \x be a partition of n — 1, and n is obtained 
from X by removing one box. Then the following formula holds 

(6.4.1) S X ^ X (t; Xl ,x 2 ,...) = J2 ^/u,x/ut lXM ~ 1 s u (x 1 ,x 2 , . . .) 

uC/j, 

where s u is the Schur symmetric function associated with the partition v, and <f a /v,\/u is a 
combinatorial coefficient associated with the skew Young diagram Xjv. This combinatorial 
coefficient is given explicitly in Theorem \S.2.1\ 

Proof. Let be a permutation from S(n) which is in the standard form 

9 = (1, 2, . . . , + 1, . . . , i 2 ) . . . (i m -i + 1, . . . , ra) 

Suppose 9 has a cyclic structure (k, p) (with respect to the conjugations by S(n — 1)). 
Then the last cycle of 9 (those one which includes n) has length k. Denote this cycle by 
a, and denote by 7r the permutation of the remaining n — k numbers. Thus 9 = tt ■ a, and 
we have 

rWA (7r . ff)=r WA > 

Theorem 13.2.11 gives the following formula for the generalized character r^,^* : 



^\,p/\ 

(M 



uGp 
v\-n—k 



Let us insert this expression into formula Ij6.3. 1|) . We find 

(k, P ) p P 
( 



fc=l 



phn—k 



£«*-' E 



-i 



k=l 



phn—k 



Y 



,X/uXp 



. uCu 

\vhn—k 



Pp 



z~ XpPp 



Y tk 1 Y ¥V",a/" Y z p^' " 

k=l ^C/i phn—k 

vhn—k 

n 

Y tk l Y ^mA-AA^' 



k=l 



u(-p 
vhn—k 



which is obviously equivalent to the formula in the statement of the Theorem. (We have 
used the well-known formula 

s " = Y z ^ l ^ v ppp 

phn — k 

in the last equation.) □ 
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6.5. The Jacobi-Trudi type formula. The Schur symmetric functions can be expressed 
as polynomials in the complete symmetric functions. The formula is 



(6.5.1) 



s\ = det (hxi-i+j) 



l<i,j<n ' 



where n > l(X), l(X) denotes the number of rows of partition A. We are looking for an 
analogue of this formula for the generalized Schur functions. 
Let l n be the identity character of S(n). Then 



(6.5.2) 



ch(l n ) = ^ Z P 1 Pp = h n- 
\p\=n 



If A = (Ai, A2, • • •) is any partition of n, let 1a denote 1\ 1 • 1\ 2 . . . with the multiplication 
defined by formula (|5,l.lj) . Then 1^ is the character of S(n) induced by the identity 
character of S\ = S\ 1 x S\ 2 and we have ch(l,\) = h\. Moreover, formula (j6,5.2j) 
enables to rewrite the Jacobi-Trudi formula, equation (|6.5.1|) . as an expression for the 
irreducible characters of S(n) in terms of the induced characters: 



X 



det (I) 



L Ai-i+i )l<i,j<n ■ 

Denote by l' k the identity character of S(k) considered as an element of C'{k). 
Proposition 6.5.1. For every k > 1, and every partition fj, = (/xi, . . . ,/U m ) we obtain 



(6.5.3) 
where 



ch'(l Ml * 



* V * Ifc) 



h 



mi 



• h Pm ■ h 'k 



(6.5.4) 

Proof. We have 
(6.5.5) 



hi 



ch'd',1 



3=1 \hk-j 



3=1 



hi 



where we have used formula (|5.3.3|) in the first equation. Since ch'(/ * g) = ch(/) ch'(g) 
for / G C{m) and g € C"(fc), the formula in the statement of the Proposition holds. □ 

Now note that equation (|6.5.4|) implies 



m-i 



\n-l 





hi 


h 2 


^3 • 


■ K 




1 


hi 


h 2 . 


■ K- 


1 





1 


hi . 


■ K- 







h'l 



If we insert this expression into formula (|6.4. lj) cind. rewrite s v as the Jacobi-Trudi deter- 
minant we obtain a Jacobi-Trudi like representation of the generalized Schur functions: 
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This is an analogue of the Jacobi-Trudi formula for the generalized Schur functions. 
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